导航栏看到页面推广gitee项目恰巧最近也在学习python了解到python爬虫很厉害想着能不能用Java把数据爬下来于是在原先框架wu-easy-excel-starter基础上新增demo进行演示测试

curl

https://e.juejin.cn/resources/gitee

\-H

{lang:java,offset:0,limit:30,cursor:0}:::

找到生成代码按钮

dependencygroupIdtop.wu2020/groupIdartifactIdwu-easy-excel-starter/artifactIdversion1.2.6-JDK17-SNAPSHOT/version/dependency编写代码

获取接口数据

HttpRequest.newBuilder().uri(URI.create(https://e.juejin.cn/resources/gitee)).header(accept,

zh-CN,zh;q0.9).header(content-type,

HttpRequest.BodyPublishers.ofString({\lang\:\java\,\offset\:0,\limit\:30,\cursor\:\0\})).build();HttpResponsebyte[]

response

HttpClient.newHttpClient().send(request,

HttpResponse.BodyHandlers.ofByteArray());byte[]

body

LinkedHashMap.class);System.out.println(map);输出格式

{code:

https://gitee.com/xiaonuobase/snowy,date:

{__type:

2024-05-10T11:45:16.000Z},summary:

最新国内首个国密前后分离快速开发平台采用Vue3AntDesignVue3

ViteSpringBootMpHuToolSaToken。

集成国密加解密插件在前后分离框架中实现前后分离“密”不可分同时实现国产化机型、中间件、数据库适配是您的不二之选最后官网提供工作流、多租户、多数据源、Vue3表单设计器等丰富插件灵活使用。

,language:

Java,category:

属性数据导出如user.id集合数据导出userList.$id字段导出id

:::

如下导出数据中的data中集合属性ID为数据ID、title属性为标题

:::

需要导出的数据设置信息ListExportFieldCommand

exportFieldCommands

ArrayList();exportFieldCommands.add(new

ExportFieldCommand(data.$id,数据ID));exportFieldCommands.add(new

ExportFieldCommand(data.$title,标题));exportFieldCommands.add(new

ExportFieldCommand(data.$username,用户));exportFieldCommands.add(new

ExportFieldCommand(data.$url,地址));exportFieldCommands.add(new

ExportFieldCommand(data.$summary,描述));exportFieldCommands.add(new

ExportFieldCommand(data.$language,语言));exportFieldCommands.add(new

ExportFieldCommand(data.$category,类型));ListEasyExcelFiledPoint

ExportFieldCommandUtils.exportFieldCommandList2EasyExcelFiledPointList(exportFieldCommands);

导出数据

设置导出数据信息DynamicEasyExcelContextHolder.pushOnlyExportField(easyExcelFiledPointList);

easyExcelPoint.setExcelFiledPointList(easyExcelFiledPointList);//

fileOutputStream

FileOutputStream(easyExcelWorkbookTest.getPath());//

执行导出excelExcelServiceAdapter.exportExcel(map,easyExcelPoint,fileOutputStream);查看数据

完整代码

com.fasterxml.jackson.databind.ObjectMapper;

import

org.wu.framework.core.utils.FileUtil;

import

org.wu.framework.core.utils.JsonUtils;

import

org.wu.framework.easy.excel.adapter.ExcelExcelServiceAdapter;

import

org.wu.framework.easy.excel.endpoint.EasyExcelFiledPoint;

import

org.wu.framework.easy.excel.endpoint.EasyExcelPoint;

import

org.wu.framework.easy.excel.endpoint.ExportFieldCommand;

import

org.wu.framework.easy.excel.factory.ExcelExcelServiceAdapterFactory;

import

org.wu.framework.easy.excel.toolkit.DynamicEasyExcelContextHolder;

import

org.wu.framework.easy.excel.util.EasyWorkbookTest;

import

org.wu.framework.easy.excel.util.ExportFieldCommandUtils;import

java.io.File;

HttpRequest.newBuilder().uri(URI.create(https://e.juejin.cn/resources/gitee)).header(accept,

zh-CN,zh;q0.9).header(content-type,

HttpRequest.BodyPublishers.ofString({\lang\:\java\,\offset\:0,\limit\:30,\cursor\:\0\})).build();HttpResponsebyte[]

response

HttpClient.newHttpClient().send(request,

HttpResponse.BodyHandlers.ofByteArray());byte[]

body

LinkedHashMap.class);System.out.println(map);//

创建一个导出适配器ExcelExcelServiceAdapter

ExcelExcelServiceAdapterFactory.excelExcelServiceAdapter();//

演示导出文件到本地String

FileUtil.readLocalClassFolder(CustomerDataExportTest.class);File

FileUtil.createFile(localClassPath,

CustomerDataExportTest.xls);EasyExcelPoint

easyExcelPoint

EasyExcelPoint();easyExcelPoint.setSheetName(导出稀土掘金首页Gitee推荐);easyExcelPoint.setUseAnnotation(false);//

不使用注解导出//

需要导出的数据设置信息ListExportFieldCommand

exportFieldCommands

ArrayList();exportFieldCommands.add(new

ExportFieldCommand(data.$id,数据ID));exportFieldCommands.add(new

ExportFieldCommand(data.$title,标题));exportFieldCommands.add(new

ExportFieldCommand(data.$username,用户));exportFieldCommands.add(new

ExportFieldCommand(data.$url,地址));exportFieldCommands.add(new

ExportFieldCommand(data.$summary,描述));exportFieldCommands.add(new

ExportFieldCommand(data.$language,语言));exportFieldCommands.add(new

ExportFieldCommand(data.$category,类型));ListEasyExcelFiledPoint

ExportFieldCommandUtils.exportFieldCommandList2EasyExcelFiledPointList(exportFieldCommands);//

设置导出数据信息DynamicEasyExcelContextHolder.pushOnlyExportField(easyExcelFiledPointList);

easyExcelPoint.setExcelFiledPointList(easyExcelFiledPointList);//

fileOutputStream

FileOutputStream(easyExcelWorkbookTest.getPath());//

执行导出excelExcelServiceAdapter.exportExcel(map,easyExcelPoint,fileOutputStream);System.out.println(map);}

当前使用框架地址

repositoriesrepositoryidoss.snapshots/idnameoss.sonatype.org/nameurlhttps://oss.sonatype.org/content/repositories/snapshots//urlreleasesenabledfalse/enabled/releasessnapshotsenabledtrue/enabled/snapshots/repository/repositories